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A SYSTEM AND METHOD FOR 
AUTOMATIC AND DYNAMIC 
LAYOUT OF RESIZABLE 
DIALOG TYPE WINDOWS 

Background of Invention 

[0001] Technical Field: 

[0002] The invention is related to software user interface windows, and in particular, 
to a system and method for automatically and dynamically sizing and positioning 
controls, including buttons/text, and other elements within a dialog window, or 
the like, of a computer software application. 

[0003] Related Art: 

[0004] Software applications or computer programs are often run or executed in a 

windowing environment. Such windowing environments include, for example, any 

® 

of the Windows operating systems, or any of a number of other conventional 
windowing environments. Most of these conventional windowing environments 

commonly use dialog windows or the like to present information and receive input 

from a user. Dialog windows typically contain one or more controls, or groups of 

controls, such controls often including text or icons for informing a user as to the 

function of the controls. 

[0005] 

Examples of typical controls used within a dialog window include both dynamic 
and static controls, such as, for example, push buttons, radio buttons, check 
boxes, edit boxes, text labels, list boxes, etc. For example, a dynamic control, such 
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as a list box, may be placed in any sort of dialog window, such as a "File Open," a 
"File Save," or any other dialog window, to provide for user input or selection. Such 
list boxes typically contain a listing of files or documents available to the user for 
opening or saving. Further, dynamic controls, such as, for example, a "cancel 
button" also often include text on the button, i.e. the word "Cancel" on the button. 
Static controls, such as text labels, display organized information, such as, for 
example, text information, but do not, by themselves, provide for or receive user 
input. 

[0006] One conventional method for creating dialog windows typically involves a 
labor-intensive process whereby every dialog box to be used by a particular 
application or computer program is laid out by manually specifying precise 
positions and dimensions of each individual control within a dialog. These 
positions and dimensions are typically stored as a set of resource data that is 
loaded by the operating system or application program whenever a particular 
dialog window is drawn or rendered. 

[0007] If the text, language, or size of controls associated with such dialog windows is 
changed, a new layout for the dialog window is often required. This new layout 
again requires manually specifying precise positions and dimensions of each 
individual control within a dialog. Consequently, when translating a computer 
application from one language to another, such as, for example, from English to 
Japanese, it is frequently necessary to completely redesign many, or all, of the 
dialog windows associated with the translated application, as the size of any text 
associated with the controls of the translated dialog window is usually significantly 
different than the original text. 

[0008] 

Further, because the position and dimensions of the controls within the dialog 
window of such schemes are fixed, resizing of such dialog windows is typically 
prevented. However, in cases where resizing of such dialog windows is allowed, 
resizing of the dialog window typically serves little purpose. For example, when the 
size of such a dialog window is decreased, the decrease in window size typically 
serves only to hide or clip portions of the controls within the dialog window. 
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Alternatively, when the size of such a dialog window is increased, the increase in 
window size serves only to waste display space by creating a larger window having 
no information or controls within the expanded area, as the positions of the 
controls within the window remain fixed as noted above. 

[0009] Other schemes for creating or laying out dialog windows have been developed 
that allow a program developer to specify the relative positions of the controls 
within the dialog window without specifying precise coordinates or dimensions of 
each control. Often, such schemes use the concept of "frames" which are disposed 
within the dialog window, and wherein each frame contains particular controls or 
other elements. At the time the dialog window is displayed (during the execution of 
the program to which the dialog belongs), these schemes automatically calculate 
O the relative coordinates and dimensions of each control and then position and size 

the controls based on those coordinates and dimensions. Such schemes provide a 
2^ way to ensure the efficient sizing and layout of the controls contained within a 

IU dialog window at the development stage of the software application to which the 

H'fJ 

J*;, dialog window belongs. The sizes and layout of these controls are acted on at run 

* time, as the dialog window is created on the user's computer. However, such 

1-1 

In systems do not allow for the dynamic resizing and repositioning of the controls 

y within a dialog window in response to a user or system action to increase or 

i: I J 

Q decrease the size of the dialog window during use of the software application to 

which the dialog window belongs. 

[001 0] st: i 1 1 other schemes for creating or laying out dialog windows have been 

developed to allow a user to resize a dialog window. Such schemes expand on the 
aforementioned schemes to automatically reorganize the controls within the dialog 
window to adapt to the new dialog window size. Again, such schemes often use 
frames for laying out particular controls, with one or more controls again being 
disposed within frames which are themselves positioned within the dialog window. 
However, while such schemes are useful, they are limited by their inability to adapt 
to cases where a dialog window is horizontally resized such that controls within a 
particular row within the dialog window or frame will no longer fit within that row. 
In such cases, the controls within the row may be partially or completely clipped, 
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so that the user is no longer able to fully view particular controls within the dialog 
window. Some schemes have attempted to address this issue by providing a scroll 
bar or the like within the dialog window to allow a user to view clipped or 
otherwise obscured portions of the dialog window. However, such schemes tend to 
degrade the user experience by requiring excessive interaction with dialog 
windows. 

1] Finally, another scheme has attempted to address the problem of clipping or 
hiding controls when reducing the size of a dialog window. In particular, as defined 
by the JAVA ™ 2 Platform, Standard Edition, v 1 .3.1 API Specification, a 
"FlowLayout" class puts components, such as controls or buttons, in a row, within a 
user resizable "container" or dialog window. As with some of the aforementioned 
schemes, the JAVA ™ FlowLayout scheme may use frames nested within the 
container to allow for relative layout of groups of controls within particular frames. 
If the horizontal space in the container, or frame within the container, is too small 
to put all the components in one row, FlowLayout automatically uses multiple rows 
to display the components by automatically wrapping the control or controls, as 
necessary to the next row. Similarly, as the container is expanded, all objects from 
lower rows that will fit into higher rows are automatically moved into the higher 
rows. Within each row, components are centered by default, and may also be either 
left-aligned, or right-aligned, as specified when the FlowLayout is created. 
However, this "FlowLayout" scheme is subject to several limitations. For example, 
the JAVA ™ FlowLayout scheme fails to account for potential relationships between 
components existing within a single frame, such as, for example, text associated 
with a particular button or control, or related controls that should be kept together 
or in some sort of preferred orientation relative to each other. 

2 ^ Therefore, what is needed is a system and method for automatically and 
dynamically sizing and positioning controls, including buttons, text, and other 
elements within frames in a window of a computer software application as the 
window is resized. Further, as the size of individual controls is changed, such as 
when text associated with such controls is translated to another language, the 
system and method should automatically resize and reposition those elements 
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within the window. In addition, such a system and method should allow for 
automatic repositioning of such elements with respect to predefined relationships 
between the elements. 

Summary of Invention 

[001 3] The present invention involves a new system and method which solves the 
aforementioned problems, as well as other problems that will become apparent 
from an understanding of the following description by using dynamically resizable 
frames, i.e., "FlowFrames," within a window of a graphical user interface, such as a 
dialog window, to automatically lay out elements within that window. In particular, 
a system and method according to the present invention builds on conventional 
automatic layout schemes by automatically and dynamically sizing and positioning 
?; [| one or more FlowFrames within a window of a graphical user interface, as well as 

one or more other frames, i.e., "child frames" contained or nested within one or 
more dynamic rows within the FlowFrame, as the window is generated or resized. 
As indicated above, each FlowFrame contains one or more child frames. These 
child frames in turn contain one or more elements, including conventional 

el 

□ controls, such as, for example, dynamic and static controls, including push 

buttons, radio buttons, check boxes, edit boxes, text labels, list boxes, etc. 



Ill 



CO 
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[0014] Further, unlike conventional frame based automatic layout schemes, in order to 
effectively utilize the area within the dialog window, the width of each row of 
children within a FlowFrame is not computed from the widths of its children. In 
particular, in accordance with the present invention, the width of each row of 
children within a FlowFrame is automatically computed based, in part, on the width 
of the dialog or other window. Further, the width of each row of children within a 
FlowFrame is also programmatically adjusted based on its insetting or indenting 
due to surrounding or otherwise related dialog elements. Finally, the relative 
positions of its child (i.e., interior or nested) frames and associated controls are 
dynamically computed based on the width of the FlowFrame and on the widths of 
the children, rather than using explicitly programmed relative positions. 

[0015] 

In other words, a FlowFrame uses additional information, other than just the 
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size of its children, to determine its own size. In particular, a FlowFrame partially 
takes its own size from the window or dialog size, which as noted below, may itself 
be dynamically resized in one embodiment, and then computes its height based on 
that width with respect to the children within that flow frame. Specifically, unlike 
conventional schemes, the FlowFrame computes its size (i.e., height and width) 
hierarchically from the controls up to the overall parent or root window, and then 
back down to the individual controls. In addition, a FlowFrame arranges its child 
frames and any associated controls horizontally in a row, like a conventional 
"Horizontal Frame," but wraps them to multiple rows if they cannot all fit in the 
same row. 

[001 6] In general, a system for automatically and dynamically laying out elements 

within a window in accordance with the present invention begins by first specifying 
at least one dynamically resizable FlowFrame within a conventional hierarchical 
tree structure defining an overall parent window. Next, at least one child frame, is 
specified or placed within the FlowFrame. The size of the FlowFrame is then 
automatically computed based on the hierarchical tree structure, beginning with 
the children within each frame, up to the overall parent window, and then back 
down to the individual children within each frame. Next, a minimum sufficient 
number of horizontal rows are instantiated within each FlowFrame for displaying 
each of the children within each FlowFrame. In addition, the children within each 
FlowFrame are automatically arranged within the automatically instantiated 
horizontal rows. This information may then be used for automatically laying out 
and drawing a window such as a dialog window of a graphical user interface. 

[001 7] conventional hierarchical tree structure noted above can be described as a 

logical, hierarchical, description of the window or dialog. This structure is created 
by dividing the window into regions, which are in turn divided into sub-regions, 
etc., all the way down to individual controls. This hierarchy is expressed as a "tree 
of frames," wherein each frame represents a rectangular region of the window. The 
root of the tree is a frame encompassing the entire window. Clearly, progressing 
down the tree, the frames get smaller and smaller, until the frame leaves are 
reached, with the frame leaves representing areas each occupied either by a single 
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control, or by a group of two or more controls functioning as a single unit. Such 
controls, or control groups, i.e., "control frames," can include any of a number of 
conventional frame types. Each type of frame that can have multiple children, or 
each group of controls, also has a built-in "relation," like vertical or horizontal, 
specifying how its children are arranged within it. While most controls appear as 
leaves of the frame tree, a control can also appear in an internal node, such as a 
group-box (label-box) frame; this kind of frame indicates the rectangle occupied 
by the actual label box control, yet it also has one child commonly a vertical frame 
of other controls, which are contained inside the group-box. Such hierarchical 
structures are well known to those skilled in the art. 

[001 8] In a further embodiment of the present invention, as the size of individual 

controls associated with a child frame within a FlowFrame is changed, such as, for 
example, when text associated with such controls is translated to another 
language, the system and method automatically resizes and repositions those 
controls within the dialog window, or within one or more FlowFrames within the 
dialog window, in accordance with a set of predefined automatic layout rules. 

[001 9] In another embodiment, the system and method of the present invention 
automatically repositions elements within a dialog window or FlowFrame with 
respect to predefined relationships between such elements such as by "binding" 
those elements. For example, where it is desired that two or more consecutive 
children of a particular FlowFrame maintain adjacent positioning with respect to 
each other, such a relationship will be automatically maintained, space permitting, 
within rows of the FlowFrame. This will hold true even where it would be possible 
to more efficiently utilize space within rows instantiated within a flow frame by 
wrapping children to subsequent rows. 

In a further embodiment, particular relationships between children or elements 
within a FlowFrame are emphasized or maintained through use of indenting 
functionality. This indenting functionality may be used when children within one or 
more rows are automatically wrapped to one or more subsequent rows. 

In still another embodiment, automatically and dynamically laying out elements 
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within a window is performed dynamically in real-time as a window is 
automatically or manually resized. For example, where a user resizes a window 
containing FlowFrames, the elements within the flow frame are automatically 
resized and repositioned in real-time as the user resizes the window. Thus, the 
user is able to watch the dynamic layout of the window as the size of the window 
changes. It should be noted that resizing of windows is a technique well known in 
the art, and can be accomplished in any number of ways, such as, for example, by 
selecting and dragging an edge or corner of the window using a conventional 
computer pointing device. 

[0022] In a related embodiment, the automatic and dynamic layout of the window, and 
thus the children within FlowFrames within the window, is not performed until 
resizing of the window is completed. In such cases, an outline of the window size 
may be presented to the user as the window is resized. Once the resizing is 
complete, such as, for example, when the user releases a selected edge or corner 
of the window, the window is then automatically and dynamically laid out and 
drawn to the screen. 

[0023] In addition to the just described benefits, other advantages of the present 
invention will become apparent from the detailed description which follows 
hereinafter when taken in conjunction with the accompanying drawing figures. 

Brief Description of Drawings 

[0024] The specific features, aspects, and advantages of the present invention will 
become better understood with regard to the following description, appended 
claims, and accompanying drawings where: 

[0025] FIG. 1 is a diagram depicting a general-purpose computing device constituting 
an exemplary system for implementing the present invention. 

[0026] FIG. 2 is an exemplary screen image showing a conventional dialog window. 

[0027] FIG. 3 is an exemplary diagram illustrating a conventional frame tree for 
describing the dialog window of FIG. 2. 
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[0028] FIG. 4 illustrates an exemplary architectural flow diagram for implementing the 
present invention. 

[0029] FIG. 5 is an exemplary schematic of a dialog window containing a FlowFrame 
having embedded children. 

[0030] FIG. 6A is an exemplary schematic of a FlowFrame having embedded children. 

[0031] FIG. 6B is an exemplary schematic of the FlowFrame of FIG. 6A, showing 
wrapping of children as the FlowFrame is reduced in width. 

[0032] FIG. 7 A is an exemplary schematic of a FlowFrame having embedded children. 

[0033] FIG. 7B is an exemplary schematic of the FlowFrame of FIG. 7A, showing 
wrapping of bound children as the FlowFrame is reduced in width. 

[0034] FIG. 8 is an exemplary flow diagram for implementing a working example of 
the present invention. 

[0035] FIG. 9 is an exemplary screen image of a task pane window having multiple 
FlowFrames, each with nested or embedded children. 

[0036] FIG. 1 0 is an exemplary screen image of the task pane window of FIG. 9, 
showing the effect on the children within each FlowFrame as the width of the 
window is decreased. 

[0037] FIG. 1 1 is an exemplary screen image of the task pane window of FIG. 1 0, 
showing the effect on the children within each FlowFrame as the width of the 
window is decreased. 

[0038] FIG. 1 2 is an exemplary screen image of the task pane window of FIG. 1 1 , 
showing the effect on the children within each FlowFrame as the width of the 
window is decreased. 

[0039] FIG. 1 3 is an exemplary screen image of the task pane window of FIG. 1 2, 
showing the effect on the children within each FlowFrame as the width of the 
window is decreased. 
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[0040] FIG. 1 4 is an exemplary screen image of the task pane window of FIG. 1 3, 
showing the effect on the children within each FlowFrame as the width of the 
window is decreased. 

Detailed Description 

[0041] In the following description of the preferred embodiments of the present 
invention, reference is made to the accompanying drawings, which form a part 
hereof, and in which is shown by way of illustration specific embodiments in which 
the invention may be practiced. It is understood that other embodiments may be 
utilized and structural changes may be made without departing from the scope of 
the present invention. 

[0042] L 0 Exemplary Operating Environment: 

[0043] Figure 1 illustrates an example of a suitable computing system environment 
100 on which the invention may be implemented. The computing system 
environment 1 00 is only one example of a suitable computing environment and is 
not intended to suggest any limitation as to the scope of use or functionality of the 
invention. Neither should the computing environment 100 be interpreted as having 
any dependency or requirement relating to any one or combination of components 
illustrated in the exemplary operating environment 100. 

[0044] The invention is operational with numerous other general purpose or special 
purpose computing system environments or configurations. Examples of well 
known computing systems, environments, and/or configurations that may be 
suitable for use with the invention include, but are not limited to, personal 
computers, server computers, hand-held, laptop or mobile computer or 
communications devices such as cell phones and PDA's multiprocessor systems, 
microprocessor-based systems, set top boxes, programmable consumer 
electronics, network PCs, minicomputers, mainframe computers, distributed 
computing environments that include any of the above systems or devices, and the 
like. 

[0045] 

The invention may be described in the general context of computer-executable 
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instructions, such as program modules, being executed by a computer. Generally, 
program modules include routines, programs, objects, components, data 
structures, etc. that perform particular tasks or implement particular abstract data 
types. The invention may also be practiced in distributed computing environments 
where tasks are performed by remote processing devices that are linked through a 
communications network. In a distributed computing environment, program 
modules may be located in both local and remote computer storage media 
including memory storage devices. With reference to Figure 1 , an exemplary 
system for implementing the invention includes a general purpose computing 
device in the form of a computer 1 1 0. 

[0046] Components of computer 1 1 0 may include, but are not limited to, a processing 
unit 120, a system memory 1 30, and a system bus 121 that couples various 
system components including the system memory to the processing unit 1 20. The 
system bus 121 may be any of several types of bus structures including a memory 
bus or memory controller, a peripheral bus, and a local bus using any of a variety 
of bus architectures. Byway of example, and not limitation, such architectures 
include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) 
bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local 
bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine 
bus. 

[0047] Computer 1 1 0 typically includes a variety of computer readable media. 

Computer readable media can be any available media that can be accessed by 
computer 1 10 and includes both volatile and nonvolatile media, removable and 
non-removable media. Byway of example, and not limitation, computer readable 
media may comprise computer storage media and communication media. 
Computer storage media includes both volatile and nonvolatile, removable and 
non-removable media implemented in any method or technology for storage of 
information such as computer readable instructions, data structures, program 
modules or other data. Computer storage media includes, but is not limited to, 
RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital 
versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic 
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tape, magnetic disk storage or other magnetic storage devices, or any other 
medium which can be used to store the desired information and which can be 
accessed by computer 1 1 0. Communication media typically embodies computer 
readable instructions, data structures, program modules or other data in a 
modulated data signal such as a carrier wave or other transport mechanism and 
includes any information delivery media. The term "modulated data signal" means 
a signal that has one or more of its characteristics set or changed in such a manner 
as to encode information in the signal. By way of example, and not limitation, 
communication media includes wired media such as a wired network or direct- 
wired connection, and wireless media such as acoustic, RF, infrared and other 
wireless media. Combinations of any of the above should also be included within 
the scope of computer readable media. 

[0048] The system memory 1 30 includes computer storage media in the form of 
volatile and/or nonvolatile memory such as read only memory (ROM) 131 and 
random access memory (RAM) 1 32. A basic input/output system 1 33 (BIOS), 
containing the basic routines that help to transfer information between elements 
within computer 1 1 0, such as during start-up, is typically stored in ROM 131. RAM 
132 typically contains data and/or program modules that are immediately 
accessible to and/or presently being operated on by processing unit 120. Byway of 
example, and not limitation, Figure 1 illustrates operating system 134, application 
programs 1 35, other program modules 1 36, and program data 1 37. 

[00491 

The computer 1 10 may also include other removable/non-removable, 
volatile/nonvolatile computer storage media. Byway of example only, Figure 1 
illustrates a hard disk drive 141 that reads from or writes to non-removable, 
nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to 
a removable, nonvolatile magnetic disk 1 52, and an optical disk drive 1 55 that 
reads from or writes to a removable, nonvolatile optical disk 1 56 such as a CD 
ROM or other optical media. Other removable/non-removable, volatile/nonvolatile 
computer storage media that can be used in the exemplary operating environment 
include, but are not limited to, magnetic tape cassettes, flash memory cards, 
digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the 
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like. The hard disk drive 141 is typically connected to the system bus 121 through 
a non-removable memory interface such as interface 140, and magnetic disk drive 
1 51 and optical disk drive 1 55 are typically connected to the system bus 121 by a 
removable memory interface, such as interface 1 50. 

[0050] The drives and their associated computer storage media discussed above and 
illustrated in Figure 1, provide storage of computer readable instructions, data 
structures, program modules and other data for the computer 1 1 0. In Figure 1 , for 
example, hard disk drive 141 is illustrated as storing operating system 144, 
application programs 145, other program modules 146, and program data 147. 
Note that these components can either be the same as or different from operating 
system 134, application programs 135, other program modules 136, and program 
data 137. Operating system 144, application programs 145, other program 
modules 146, and program data 147 are given different numbers here to illustrate 
that, at a minimum, they are different copies. A user may enter commands and 
information into the computer 1 1 0 through input devices such as a keyboard 1 62 
and pointing device 1 61 , commonly referred to as a mouse, trackball or touch pad. 
Other input devices (not shown) may include a microphone, joystick, game pad, 
satellite dish, scanner, or the like. These and other input devices are often 
connected to the processing unit 1 20 through a user input interface 1 60 that is 
**i coupled to the system bus 121, but may be connected by other interface and bus 

structures, such as a parallel port, game port or a universal serial bus (USB). A 
monitor 1 91 or other type of display device is also connected to the system bus 
121 via an interface, such as a video interface 190. In addition to the monitor, 
computers may also include other peripheral output devices such as speakers 1 97 
and printer 196, which may be connected through an output peripheral interface 
195. 

[0051] Tl _ , , , ■ , . , 

The computer 1 10 may operate in a networked environment using logical 

connections to one or more remote computers, such as a remote computer 1 80. 

The remote computer 1 80 may be a personal computer, a server, a router, a 

network PC, a peer device or other common network node, and typically includes 

many or all of the elements described above relative to the computer 110, 
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although only a memory storage device 181 has been illustrated in Figure 1. The 
logical connections depicted in Figure 1 include a local area network (LAN) 1 71 and 
a wide area network (WAN) 1 73, but may also include other networks. Such 
networking environments are commonplace in offices, enterprise-wide computer 
networks, intranets and the Internet. 

When used in a LAN networking environment, the computer 1 10 is connected 
to the LAN 1 71 through a network interface or adapter 1 70. When used in a WAN 
networking environment, the computer 1 1 0 typically includes a modem 1 72 or 
other means for establishing communications over the WAN 1 73, such as the 
Internet. The modem 1 72, which may be internal or external, may be connected to 
the system bus 121 via the user input interface 160, or other appropriate 
mechanism. In a networked environment, program modules depicted relative to the 
computer 1 1 0, or portions thereof, may be stored in the remote memory storage 
device. Byway of example, and not limitation, Figure 1 illustrates remote 
application programs 1 85 as residing on memory device 181. It will be appreciated 
that the network connections shown are exemplary and other means of 
establishing a communications link between the computers may be used. 

The exemplary operating environment having now been discussed, the 
remaining part of this description will be devoted to a discussion of the program 
modules and processes embodying the present invention. 

2.0 Introduction: 

The present invention involves a new system and process for automatically and 
dynamically laying out elements within a window of a graphical user interface by 
using dynamically resizable frames, i.e., "FlowFrames" disposed within the window. 
Such windows include, for example, a dialog window, task pane, or workpane of a 
computer software application. FlowFrames are automatically and dynamically 
sized and positioned within the window of a graphical user interface, along with 
one or more other frames, i.e., "child frames" contained or nested within one or 
more dynamic rows within the FlowFrame, as the window is generated or resized. 
The child frames contained or nested within each FlowFrame in turn contain one or 
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more elements, including conventional controls or control groups, such controls, 
including, for example, dynamic and static controls, including push buttons, radio 
buttons, check boxes, edit boxes, text labels, list boxes, etc. 

[0056] Further, a FlowFrame arranges its children horizontally in a row, like a 

conventional "Horizontal Frame," but dynamically wraps the children to one or 
more additional rows, as necessary, in accordance with predefined relationships 
between the children, where they cannot all fit into the same row. Further, each 
FlowFrame computes its size hierarchically from its children up to the overall 
window and then back down to the individual children. Thus, the system and 
method of the present invention expands on the conventional concept of dialog 
"AutoLayout" by the addition of "FlowFrames" as described herein. 

[0057] It should be noted that the following discussion makes reference to wrapping 
of rows within a FlowFrame from a right-to-left context. In other words, the 
following discussion assumes that the rightmost object or objects will wrap in a 
FlowFrame, as described below, where there is insufficient horizontal space within 
the FlowFrame to host all of the objects in a single row. However, it should be 
understood that the right-to-left context of wrapping presupposes an English 
language or similar context wherein text is read from left to right. Clearly, 
wrapping may also occur in a left-to-right fashion wherein the leftmost object or 
objects will wrap in a FlowFrame where there is insufficient horizontal space within 
the FlowFrame to host all of the objects in a single row. Such wrapping is 
appropriate, for example with certain foreign language versions of a dialog window 
using FlowFrames where the language is read in a right-to-left fashion, such as, 
for example, Arabic and Hebrew. Therefore, for purposes of clarity, only right-to- 
left wrapping is discussed below. However, in the context of the present invention, 
wrapping may clearly occur in either a right-to-left manner, or in a left-to-right 
manner, as desired. 

[00 58] 2.1 AutoLayout Overview: 

[0059] Byway of introduction, a conventional AutoLayout process is briefly 

summarized by the following discussion. In particular, to prepare a window, such 
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as a dialog window, for automatic layout computation, a developer must first 
provide a logical, hierarchical "AutoLayout description" of the dialog, by dividing it 
into regions, which are in turn divided into sub-regions, etc., all the way down to 
individual controls. This hierarchy is expressed as a "tree of frames," where each 
frame represents a rectangular region of the dialog. The root of the tree is the 
frame encompassing the entire dialog. Further, progressing down the tree, the 
frames get smaller and smaller, until the frame leaves are reached. The frame 
leaves are those frames representing areas each occupied by either a single 
control, or by a group of two or more controls functioning as a single unit. Such 
frames, i.e., "control frames," can include any of a number of conventional frame 
types. 

[0060] There are many different kinds of frames, each engendered by a different C+ + 
class, or other programming language class which can be contained or nested 
within a FlowFrame. Further, each type of frame that can have multiple children 
also has a built-in "relation," like vertical or horizontal, specifying how its children 
. are arranged within it. While most controls appear as leaves of the frame tree, 
sometimes a control appears in an internal node, such as a group-box (label-box) 
frame; this kind of frame indicates the rectangle occupied by the actual label box 
control, yet it also has one child commonly a vertical frame of other controls, which 
are contained inside the group-box. 

t° 06 ^ By way of example, FIG. 2 and FIG. 3 illustrate the decomposition of a simple 
dialog window (FIG. 2) into its frame hierarchy (FIG. 3). Thus, FIG. 3 provides an 
appropriate frame tree for the automatically laid out Zoom dialog (FIG. 2) based on 
that tree. In particular, referring both to FIG. 2 and Fig. 3, the Zoom dialog window 
200 of FIG. 2 includes a horizontal frame 300 which contains a group box 3 1 0 
having a horizontal frame 31 5 graphically delimited by the "Zoom To" area 21 0 of 
the Zoom dialog 200. This horizontal frame 31 5 further comprises a vertical frame 
320 which includes individual sibling leaf frames 321 through 327 holding the 
controls indicating the zoom amount, i.e. "Fit," "400%," "200%," "100%," etc., as 
illustrated in FIG. 2. Further, the horizontal frame 31 5 also includes a number 
input frame 330 having both a text label 230, and a "%" label 240. In addition, the 
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horizontal frame 300 includes a vertical frame 340 which further includes leaf 



frames having an "OK" control 350 (button 250 of FIG. 2) and a "Cancel" control 
360 (button 260 of FIG. 2). Clearly, the concepts illustrated by FIG. 2 and FIG. 3 
may be applied to construct a "tree of frames" for a window, such as a dialog 



window, of any desired complexity. 



[0062] 



Before invoking the AutoLayout computation via an "AutoLayout engine," the 



minimum that a developer needs to do is set up the tree of frames, as described 
above. Typically, this is accomplished by defining all necessary frame objects 
(parent frames before children, and sibling frames in the order of their 
arrangement within their parent) passing into each child frame's constructor a 
pointer to its parent frame. Then, a conventional LayoutO method is called on the 
root of the tree, i.e., horizontal frame 300 of FIG. 3, and all controls will 
automatically resize and reposition themselves to form a reasonable-looking 
dialog. Controls are all assigned default sizes depending on the control type 
and/or the length of the control's text, default margins (the spacing between 
adjacent controls), and default alignment schemes (generally top-left aligned). But 
if a developer chooses, any of these defaults may be overridden by setting 
preferences for these characteristics on a frame-by-frame basis, before calling 
LayoutO. 

[0063] Other layout options can also be specified. For example, unequal sizes among 
children of the same parent (siblings) will often result in the smaller children 
having excess "packing area." The packing area represents a rectangular area 
within a parent frame that is reserved exclusively for a particular child frame within 
that parent frame, and which no sibling will ever invade. Consequently, in order to 
reduce wasted or unused space within a parent frame, the AutoLayout functionality 
includes the capability of specifying that any frame at any level in the hierarchy be 
expanded, either horizontally, vertically, or both, to fill any available excess space. 

[0064] 2.2 FlowFrames Overview: 

[0065] As notec j a b ovej the present invention expands on the aforementioned concept 
of AutoLayout by the addition of FlowFrames. FlowFrames are automatically and 
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dynamically sized and positioned within a window using the AutoLayout 
functionality described above, while any children within each FlowFrame are 
automatically and dynamically sized and positioned within automatically and 
dynamically created rows within each FlowFrame. In particular, a FlowFrame 
arranges its children horizontally in a row, like a conventional "Horizontal Frame," 
but dynamically wraps the children to one or more additional rows, as necessary. 
Further, in one embodiment, this wrapping is regulated in accordance with 
predefined relationships between the children, where they cannot all fit into the 
same row. Finally, each FlowFrame computes its size hierarchically from its 
children up to the overall window and then back down to the individual children. 
The automatic layout of FlowFrames is described in further detail below in Section 
3.0. 

[0066] Further features of FlowFrames, as discussed in greater detail below, include, 
for example, the capabilities of setting margins between rows in a FlowFrame, 
adjusting the width of rows within a FlowFrame, indenting entire FlowFrames, or 
certain rows within a FlowFrame, indenting and/or justifying wrapped children (left, 
right, or center justifying), distributing rows to fill available space within a 
FlowFrame, distributing children within rows, binding children in groups of two or 
more for controlling how children wrap, determining which row within a FlowFrame 
children are wrapped into, and expanding particular children to fill particular rows. 
Additionally, FlowFrames also provide the capability to specify the vertical 
alignment of child frames within a particular row of a given FlowFrame. For 
example, with respect to such vertical alignment, child frames of different heights 
that appear in the same row of a FlowFrame can be top, center, or bottom aligned 
with respect to each other in their row. Section 3.1 below provides exemplary 
methods for implementing these features and defining relationships between 
children within a FlowFrame. 

[0067] 2.3 System Overview: 

[0068] 

FIG. 4 is a general system diagram illustrating program modules for 
implementing the present invention. It should be noted that the boxes and 
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interconnections between boxes that are represented by broken or dashed lines in 
FIG. 4 represent alternate embodiments of the present invention, and that any or 
all of these alternate embodiments, as described below, may be used in 
combination. 

[0069] In general, the present invention dynamically and automatically lays out 

elements within a window by using dynamically resizable FlowFrames disposed 
within a window. In particular, with reference to FIG. 4, in combination with FIG. 1 , 
and FIG. 2, FIG. 4 illustrates interaction between an exemplary operating system 
(134 of FIG. 1), an exemplary software application program 1 35, a dialog manager 
module 320 for managing dialog windows and the like, and an AutoLayout module 
330 in accordance with the present invention. In accordance with the present 
invention, when the software application program 1 35 is presented with a window, 
such as, for example, a dialog window or task pane, (see 200 of FIG. 2 for an 
example) that window may be resized, either automatically, or by user interaction 
with the window via a user interface module 340. Techniques for resizing such 
windows 200 are well known to those skilled in the art. 

[0070] The dialog manager module 320 is a program module containing computer 
executable instructions for managing the display of the window 200 on the user's 
computer 1 00 in connection with the software application program 1 35. The dialog 
manager module 320 may be a program module resident in the software 
application program 1 35, or as is well understood by those skilled in the art, the 
dialog manager module may be a dynamic-link library (DLL) that is a set of 
computer executable routines that may be called by any of a number of software 
application programs for execution of its functionality. After the dialog manager 
module 320 is notified by the operating system 1 34 that the window 200 is being 
resized, the dialog manager module 320 notifies the software application program 
1 35, which then calls the AutoLayout module 330. 

[0071] 

The AutoLayout module 330 is a program module containing the functionality 
for laying out the placement and size of all of the controls contained within the 
window 200, as discussed in further detail below in Section 3.0. When the window 
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200 is created during runtime of the software application program 1 35, the 
AutoLayout module 330 determines the layout of the dialog window 200 in 
accordance with rules set up by the developer of the software application program 
1 35. Those rules may include, among other things, the size of the window 200, 
including its width and height in a standard measuring system such as pixels. The 
rules may also include the size of all controls to be located within the borders of 
the window 200. Further, the rules may also include the relative positions of the 
FlowFrames, within the borders of the dialog window 200, as well as any 
relationships between any children within particular FlowFrames. Such 
relationships between children may include, as noted above, grouping or desired 
relative positions between two or more controls or groups of controls within 
particular FlowFrames. 

[0072] In general, a set of rules for governing the layout of the window 200 do not set 
specific locations of and distances between controls. In contrast, these rules 
instruct the AutoLayout module 330 on the relative locations of those controls. For 
example, referring back to FIG. 2, the rules for a given window 200 may require 
that a "Cancel" button 260 be placed in the upper right-hand corner of a 
FlowFrame within the window, while an "OK" button 250 is to be placed to the 
immediate left of the Cancel button with the same row of the FlowFrame, space 
permitting. According to those rules, when the AutoLayout module 330 lays out 
the window 200, it places the Cancel button 260 in the upper right-hand corner, 
with the OK button 250 to its left. If the size of the window 200 is changed, the 
AutoLayout module 330 follows the rules set by the software application developer 
and maintains the Cancel button 260 in the upper right-hand corner of the window 
regardless of the size of the dialog window 200, while the OK button 250 will 
remain to the left of the Cancel button so long as they both fit into the same row of 
the FlowFrame. When these buttons no longer both fit into the same row of the 
FlowFrame, a new row is instantiated within the FlowFrame below the row in which 
the Cancel button 260 currently resides, and the Cancel button is moved to the 
right corner of the newly instantiated row, as is illustrated in FIG. 2. 



[0073] 



After the size of the window 200 is changed during operation of the software 
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application program 1 35, the AutoLayout module 330, in accordance with the rules 
set by the program developer, places and sizes the FlowFrames, and the children 
within each FlowFrame within the newly sized dialog window. Similarly, in a related 
embodiment, during resizing of the window 200, the AutoLayout module 330 
dynamically places and sizes the FlowFrames, and the children within each 
FlowFrame while the window is being resized. As the AutoLayout module 330 
determines the positions and sizes of the FlowFrames, and the children within each 
FlowFrame in the window 200, the AutoLayout module calls each FlowFrame and 
child to be moved or resized as necessary. For example, after the AutoLayout 
module 330 determines to move the Cancel button 260, as described above, the 
AutoLayout module notifies the Cancel button that it needs to change its state of 
size and/or position within the FlowFrame. 

[0074] In one embodiment, a minimum size is set for the window 200 by the 

AutoLayout module 330, and the minimum size is stored by the dialog manager 
320. If a user attempts to resize the window 200 to a size less than the minimum 
size, the dialog manager 320 prevents the user from so doing. Alternately, in a 
related embodiment, the FlowFrames and children within the FlowFrame in a 
window 200 have a minimum size, and they will not be reduced below that size. 
However, the window 200 itself may actually be reduced in size to a point where it 
is smaller than the minimum size of one of the FlowFrames in the window and the 
children within a row of that FlowFrame. Consequently, in this embodiment, the 
user is presented with scroll bars or the like so that hidden or clipped portions of 
the window 200 may be observed and interacted with by the user. 

[0075] Finally, in one embodiment, the dialog manager module 320 lays out the 

window 200, including all controls contained therein, on a bitmap off the screen of 
the user's computer 1 00. Once the entire window 200 is constructed as a bitmap, 
the dialog manager module 320 sends the bitmap of the resized window 200 to 
the display 1 91 of the user's computer 1 00. This process may also be used in the 
case where the window 200 is dynamically rendered to the user's display 1 91 while 
the resizing is ongoing. 
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[0076] 



3.0 Operation Overview: 



[0077] The above-described program modules are employed to automatically and 

dynamically size and position one or more FlowFrames within a window, such as, 
for example, a dialog window, of a computer software application, and any 
controls, text, nested frames or FlowFrames, or any other elements, i.e., "children," 
within such FlowFrames as the window is generated. This process is depicted in the 
flow diagram of FIG. 8 following a discussion of exemplary methods for 
implementing the aforementioned programs modules. 

[0078] 3. 1 Exemplary Methods for Implementing the Program Modules: 

[0079] A working example of a system and method in accordance with the present 

invention uses a conventional object-oriented paradigm, in which a "class" defines 
a set of "attributes" and "methods." However, it should be appreciated by those 
skilled in the art that a non-object-oriented embodiment may be implemented 
using the concepts described herein. With respect to the object-oriented paradigm, 
an "object" of the class includes the "attributes" and "methods" of the class. A 
method comprises program code, and is analogous to a "function" that can be 
invoked on a particular object. A "subclass" of a class may be defined, wherein the 
subclass "inherits" the attributes and methods of a "superclass," i.e., the parent 
class. The inherited attributes and methods may be modified, or new attributes 
and methods may be added to the class. An object of the subclass correspondingly 
obtains the attributes and methods of the subclass. 

[0080] |n accorc j ance W j t h t hj s brief discussion of the relationship between objects, 

methods, attributes, and classes, it should be noted that in a working embodiment 
of the present invention, FlowFrames, as described herein, can be considered as a 
subclass of a "CompositeFrame" class which is in turn a subclass of a "Frame" class, 
each as defined and described with respect to conventional C and C+ + 
programming languages and the like. Consequently, the methods of the 
conventional CompositeFrame and Frame classes, which are inherited by sub- 
classes, such as, for example, "HorizFrame," "VertFrame," and "TableFrame" 
classes, will also apply to the FlowFrames class as a sub-class of the 
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CompositeFrame class. Classes such as CompositeFrame, Frame, HorizFrame, 
VertFrame, TableFrame, etc., are well known to those skilled in the art. Therefore, 
as such classes are well known to those skilled in the art, particular methods 
belonging to such classes are introduced below to illustrate exemplary FlowFrame 
functionality without fully defining the particular methods of the known, 
conventional, classes. Further, it is clear that the methods embodied in the 
FlowFrames class may be implemented with programming languages other than C 
and C+ + . 

[0081] Exemplary FlowFrame class definitions for implementing a system and method 
according to the present invention are provided in the following sections which 
contain comments explaining exemplary FlowFrame class methods. The FlowFrame 
class represents an internal node in a tree of frames in which the root node 
represents the entire window or dialog, the leaf nodes represent individual 
controls, and the internal nodes represent rectangular regions or sub-regions of 
the window or dialog. It should be appreciated by those skilled in the art that, in 
operation, such FlowFrame methods can be called by client programmers to 
customize the behavior of individual FlowFrames. Further, it should be appreciated 
that such methods may be used in numerous combinations with the methods of 
the FlowFrame class, as well as with the methods of parent classes such as 
CompositeFrame and Frame. As such, the methods of the FlowFrames class are 
clearly not limited to the examples provided herein. Further, while the methods 
described below are discussed with reference to dialog windows, it should be 
appreciated that such methods are applicable to any type of window that can be 
displayed in a windowing environment. 

[0082] ^ j j vertical Margin Method:l\\\s method, i.e., "SetVertMargin" is used for 
setting the vertical margin between rows within a FlowFrame. All rows within a 
particular FlowFrame share the same margin, since it is initially unknown which 
children will end up in which row within the FlowFrame. This method is useful for 
allowing a program developer or user to set vertical margins between the rows to 
other than a default separation. Further, in one embodiment, this method may be 
used to specify the vertical margin between rows as a proportion of the height of a 
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main font used in the dialog window. This way, if the dialog window is modified to 
use a larger or smaller font, the spacing between rows is automatically adjusted 
accordingly. Additionally, in a working example of the present invention, horizontal 
margins between children within a particular FlowFrame are set by calling a 
conventional Frame::SetMargin() method on the individual children. 

[0083] 3.1.2 Shrink Width Method: This method, i.e., "ShrinkWidthBy" is used to 

reduce a "flow width" of the rows of a particular FlowFrame by a specified amount. 
By default, when a FlowFrame is constructed, the width, i.e., the "flow width" of 
that FlowFrame is set equal to the dialog window's visible client width, i.e., the size 
of the visible window, minus any left and right border margins. However, if the 
FlowFrame is positioned using an additional indentation from the left side of the 
dialog window, then the default flow width will be too great, and the FlowFrame 
may extend past the right side of the visible window. In such a case, clipping of the 
children or controls within the FlowFrame may occur. Among other things, this 
function is useful for correcting such discrepancies. 

[0084] One example of using the "ShrinkWidthBy" method in combination with 

conventional methods of the aforementioned classes, i.e., CompositeFrame, Frame, 
HorizFrame, VertFrame, TableFrame, etc., is provided by the following text. For 
example, a FlowFrame may be placed inside a conventional GroupBoxFrame, which 
is used to place a conventional group box or similar control around a group of 
other controls, insetting them within the surrounding control by certain standard 
left, right, top, and bottom margins. In this case, ShrinkWidthBy 
(GROUPBOX_LEFT_MARGIN + G ROU PBOX_ RIG HT_ M ARG I N) may be called to account 
for the extra insetting of the FlowFrame from the left and right borders of the 
dialog window, so that the right side of the FlowFrame doesn't extend beyond the 
right side of the dialog, nor far enough to push the right side of the group box 
control beyond the right side of the dialog. 



[0085] 



For example, as illustrated by FIG. 5, an exemplary schematic of a dialog 
window 500 contains two group box frames, Frame A and Frame B, 510 and 520, 
respectively. The Frame B group box 520 includes a FlowFrame 530 having 
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children 540, 550 and 560. Because the default or specified interior margins for 
the Frame B group box 520 will be known, use of the ShrinkWidthBy method on the 
FlowFrame 530 included within the Frame B group box will serve to resize the 
FlowFrame to fit within the margins of the Frame B group box. Consequently, there 
is no need for the user or developer to manually compute and specify the final size 
of the FlowFrame 530 when insetting or nesting the FlowFrame within the Frame B 
group box. The user or developer can instead take advantage of the automatically 
computed initial width of the FlowFrame 530 and simply reduce the width by the 
necessary amount. 

Alternatively, to discard the automatically computed default initial flow width 
altogether, and set a custom width that may or may not even be related to the 
width of the dialog window, the SetWidthO method (inherited from the Frame class) 
may be called on the FlowFrame. Further, in one embodiment, if a FlowFrame is 
indented explicitly by calling a conventional IndentO or IndentByO method 
(inherited from the Frame class), rather than implicitly by inserting it into a parent 
frame that automatically insets or indents it such as a GroupBoxFrame, then a 
corresponding call to ShrinkWidthByO is not necessary, as the flow width will shrink 
automatically by the amount of the indent. 

3 

III [0087] 3. 1.3 Indent Latter Rows Method: This method, i.e., "IndentLatterRows," indents 
12 all rows after the first, by a standard indent width. In other words, this method will 

automatically align elements using a standard indent as they wrap into new rows 

as the window shrinks. 

[0088] 3. 1.4 Specify Indent Latter Rows Method: This method, i.e., 

"IndentLatterRowsBy," indents all rows after the first row, by a specified indent 
width. In other words, this method will automatically align elements using a 
specified indent as they wrap into new rows as the window shrinks. 

[0089] 3 ] s Indent Latter Rows by First Child Method: J\\\s method, i.e., 

"IndentLatterRowsByFirstChild," indents all rows after the first row, such that the 
left edge of the first child in each of the subsequent rows aligns with the left edge 
of the second child of the first row. If any latter row child is too wide to fit (even in 



[0086] 
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its own row) after being indented by that amount, then all of the latter rows are 
indented only by the standard indent width, assuming that the standard width is 
less than the specified width, and the FlowFrame's second child moves down to 
start on a new row, also indented by the standard indent width. 

[0090] For example, as illustrated by FIG. 6A and FIG. 6B, the 

IndentLatterRowsByFirstChild method is useful where two or more children have a 
relationship which it is desired to maintain. In particular, FIG. 6A shows a 
FlowFrame 600 having three child frames with associated controls, "Child Text 
Label" 610, "Child Control A" 620, and "Child Control B" 630. Child Control A 620 
is separated from Child Text Label 610 by either a standard or specified margin 
from the right edge of Child Text Label. In this case, it is desired to keep Child 
Text Label 61 0 in association with both Child Control A 620 and Child Control B 
630. Consequently, as the width of the FlowFrame is reduced as illustrated by FIG. 
6B, using the IndentLatterRowsByFirstChild method on the FlowFrame of FIG. 6A 
serves to automatically cause Child Control B 630 to be left aligned with Child 
Control A 620 as Child Control B wraps to the next row and is indented by the size 
of the first child, i.e. Child Text Label 61 0, plus the margin following it. 

[0091] 3. 1.6 Distribute Rows Method: J\\\s method, i.e., "DistributeRows," Makes the 
rows repel each other, and spread throughout the available space with equal 
distances between each of the rows. 

[0092] J. L7 Distribute Children Method: This method, i.e., 

"DistributeChildrenHorizontal," makes the children in a row repel each other, and 
spread throughout the available space with equal horizontal margins between the 
children in the row. 

[0093] 3 J. 8 Bind Child Pair Method: This method, i.e., "BindChildPair," binds a first 
child with the child immediately following it. In addition, this method, called in 
succession, is useful for binding a set of more than two children. The bound set of 
children will all be kept in the same row whenever the flow width is great enough 
to make that possible, even if that results in less efficient use of the preceding and 
succeeding rows. But if the flow width is too narrow to hold them all in the same 
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row, then the bound set will be broken up into multiple rows, without any special 
indentation of the latter rows of the bound set aside from existing indentation due 
to any of the IndentLatterRowsO methods, i.e., IndentLatterRows, 
IndentLatterRowsBy, or IndentLatterRowsByFirstChild. Further, if a bound set of 
children must be broken into multiple rows, then no child from outside of that 
bound set will appear on the same row as any child from that bound set. 

[0094] For example, as illustrated by FIG. 7 A and FIG. 7B, the BindChildPair method 
ensures that a desired spatial or visual relationship between children can be 
maintained, space permitting, regardless of how many rows are created by the 
FlowFrame. In particular, as illustrated in the FlowFrame 700 of FIG. 7A, the 
FlowFrame includes four child frames with associated controls, "Child Text Label A" 
O 710, "Child Control A" 720, "Child Text Label B" 730, and "Child Control B" 740. 

f f l The BindChildPair method has been used in this example to bind the first control, 

3 "Child Text Label A" 710, to the second control, "Child Control A" 720. Further, the 

BindChildPair method has also been used in this example to bind the third control, 
"Child Text Label B" 730, to the fourth control, "Child Control B" 740. When the 
width of the FlowFrame is reduced from its initial size to the point where the 
dashed line 750 crosses the dialog window, the FlowFrame is automatically 
vertically resized, and both the third and fourth controls, "Child Text Label B" 730, 
and "Child Control B" 740, respectively, wrap to a newly instantiated row below the 
top row, as illustrated by FIG. 7B. It can be seen by FIG. 7A that the dashed line 
750 actually crosses the position of the fourth control, "Child Control B" 740. 
Consequently, there is still sufficient room within the resized row of the FlowFrame 
to hold the third control, "Child Text Label B" 730. However, because the third 
control, "Child Text Label B" 730, has been bound to the fourth control, "Child Text 
Label B" wraps with the fourth control as described above and as illustrated by FIG. 
7A and FIG. 7B. 

[0095] 3 j g fat Row Method: This method, i.e., "GetRowOccupiedByChild," returns 
the row number that the child is in. This method can only be called after LayoutO, 
since the child frames are not yet assigned to rows prior to LayoutO. There is no 
convenient way to tell in advance which row any of the children will end up in after 



ffij 
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resizing a FlowFrame. Consequently, this method is very useful in that it allows for 
further customization of children within a FlowFrame depending upon their 
orientation and their neighbors in any given row. For example, a simple example of 
a FlowFrame includes three child frames with associated controls in a single row of 
a FlowFrame, i.e., a text label followed to the right by an edit box, followed to the 
right by a drop-down box, respectively. Given this simple example, one exemplary 
utility of the GetRowOccupiedByChild method is to provide a simple "If type logic 
test within the code describing the FlowFrame such that if the edit box winds up in 
the same row as the text label then, in a second AutoLayout iteration, expand the 
edit box vertically or horizontally to fill the available space within the row or frame. 
Clearly, the utility of this method is not limited by this simple example, which is 
provided merely as example of one of a number of uses for the 
??\ GetRowOccupiedByChild method. 

in 

[0096] 3 J JO Expand Child to Fill Row Method: This method, i.e., 

Ill 

"ExpandChildToFillRowVert," expands the child to fill the vertical space in the row, 

fjf without expanding the row height. To also expand the row to fill all available 

* vertical space in the FlowFrame, the method ExpandToFillVertO, which is defined 

j:; for the Frame class and can therefore be called on any frame, is called on the child. 

||j [0097] 3.2 Process Operation: 

%~\ 

ii=i? [0098] As noted above, the program modules described in Section 2.0 with reference 
to FIG. 4 are employed to automatically and dynamically size and position one or 
more FlowFrames within a window of a graphical user interface as the window is 
generated or resized. Further, child frames, representing one or more controls, as 
described above, are sized and positioned within one or more dynamic rows within 
the FlowFrames as the window is generated or resized. This process is depicted in 
the flow diagram of FIG. 8. It should be noted that the boxes and interconnections 
between boxes that are represented by broken or dashed lines in FIG. 8 represent 
alternate embodiments of the present invention, and that any or all of these 
alternate embodiments, as described below, may be used in combination. 

[00991 

Referring now to FIG. 8 in combination with FIG. 4, the process is started by 
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constructing one or more FlowFrames (Box 81 0) within a parent or root frame 
representing an overall widow, dialog window, or task pane. Next, any number of 
child frames representing controls, labels, text, etc., are inserted into the 
FlowFrame (Box 820) in a manner similar to inserting such objects into a 
conventional frame. Once the FlowFrames have been populated with children, a 
hierarchical tree of frames is generated (Box 830) which illustrates the 
relationships between all of the frames and children within and up to the root 
frame. See Section 2.1 and FIG. 3 for a discussion of a hierarchical tree of frames. 

00] Next, an automatic recursive preparation for FlowFrame layout (Box 840) 
begins for the FlowFrames within the overall window. This recursive preparation 
begins by setting the flow width of each FlowFrame equal to the width of the 
overall window, less any margins or indenting for particular FlowFrames, as 
described above. Further, during this step, if all children of a particular FlowFrame 
are control frames representing controls of the same type, then the vertical 
margins between the rows of the FlowFrame may be automatically changed from 
the default vertical margin size to the standard margin size for vertically separating 
controls of that specific type. The preparation for FlowFrame layout (Box 840) is 
recursive in the sense that the preparation recurses down the hierarchical frame 
tree until the frame leaves are reached. 

^ 1 ' Once the flow widths and vertical margins have been set (Box 840), constraints 
are calculated for each FlowFrame (Box 850). These constraints represent the 
minimum space requirements of each FlowFrame. In particular, the constraints 
calculate the minimum area required by each frame by traversing the tree in 
postfix (bottom-up) order. Each leaf control frame knows its own space 
requirements, based either on the default size or a size explicitly set by the 
developer. Going up the tree, each parent frame automatically figures out how 
large a rectangle it needs in order to fit all of its children and the margins between 
them. For example, during this step, each FlowFrame arranges its children into 
rows, so that it can use the number and heights of its rows in computing its own 
minimum size. After the root frame has determined its size requirements, the total 
size of the window or dialog is known. Further, as described below, in one 
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embodiment, the window is resizable using conventional techniques for resizing 
windows in a windowing environment, either automatically, or by user action via a 
user interface. Thus, in such an embodiment, the size of the root frame is 
determined via resizing of the window. 

[0102] Once the size constraints for each FlowFrame have been calculated (Box 850), a 
final position of each FlowFrame within the overall window is calculated (Box 860). 
In particular, a recursive procedure is used to calculate the final positions for the 
flow frames which includes adjusting the final sizes of all frames and setting frame 
positions within the overall window or dialog. This is done by traversing the 
hierarchical tree in prefix (top-down) order. The root sets the position of each of 
its children within the dialog. Each child, now knowing where its own rectangle is 
positioned, sets the position of its children, and so on, until the position of every 



|f j control is set. Sizes (width and height) of frames are not usually changed in this 

R| second phase of the algorithm, unless an expand-to-fill-available-space option or 

the like was specified using a method inherited from one of the conventional 
classes discussed above. 

[0103] The calculated final positions for all FlowFrames (Box 860), are then used to 

create a final layout for the overall window. In particular, the final size and position 
of each flow frame is known from the step described with respect to Box 860, 
while the minimum size and margins for each of the children within each 
FlowFrame is known from the steps described with respect to Box 840 and 850. 

[01 04] Finally, once the steps described above have been completed, the layout of the 
window may be saved for later use, or alternately, the layout information may be 
used to render the window to a display device having a graphical user interface 
(Box 870 of FIG. 8) using conventional techniques. For example, as discussed 
herein, the step of drawing the window to the screen can be done off-screen, then 
rendered to the display, or may be done on-screen in real time as a window 
containing FlowFrames is resized. 



[0105] 



In addition, it should be noted that in one embodiment, text type controls, i.e., 
a static text label, or a checkbox or radio button control containing an included 
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text label, or the like, within a FlowFrame will automatically wrap where there is 
insufficient horizontal space available. In particular, a FlowFrame will automatically 
wrap text controls that are too wide to fit within the flow width of a given row of 
the FlowFrame as a single unwrapped text line. Further, it should be noted that 
such wrapping does not occur in a new FlowFrame row, but rather, within the same 
FlowFrame row. In particular, a text control is made to wrap simply by reshaping it 
to be narrower and taller such that more than one row of text, as needed, will fit 
within the text control, which is itself contained within a single FlowFrame row. In 
other words, the text control remains a single, rectangular control in a single row 
of the FlowFrame. 

[0106] 4.0 Working Example: 

[01 07] In a simple working example of the present invention, a series of screen 

images, illustrated by FIG. 9 through FIG. 14, is used to demonstrate the concept 
of FlowFrames in accordance with the present invention by showing the 
incremental effect of continuing to narrow a dialog window. In particular, this 
sequence of screen images illustrates how a Slide Transition task pane window 
automatically adjusts its layout as it is made increasingly narrow by the user. 

[01 08] FIG. 9 illustrates a relatively wide task pane, i.e. a dialog window, in which 

there is sufficient room so controls that "prefer" to appear in the same row all do. 
There are four such rows, 910, 911, 912, and 91 3, with each row being 
represented by a separate FlowFrame, indicated by the boxes drawn with dashed 
lines superimposed on the screen images. Further, as illustrated by FIG. 9 through 
FIG. 1 4, each of FlowFrames 910,911, and 91 2 are indented relative to the fourth 
FlowFrame 91 3. This indenting can be seen be comparing the leftmost edge of 
each of the FlowFrames, 910, 91 1, 912 and 913. As discussed above, the amount 
of indent for FlowFrames, such as FlowFrames 91 0, 91 1 , and 91 2, can be either 
implicitly determined from their nesting within other frames, or explicitly specified 
by a user or program developer. 

[01 09] The fjrst F | owFrame 91 o j nc | u des a "Speed" label 91 5 and dropdown 920 in a 
single row. The second FlowFrame 91 1 includes a "Sound" label 925, dropdown 
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control 930, and a "Loop until next sound" checkbox 935 in a single row. The third 
FlowFrame 91 2 includes an "Automatically after" checkbox 940, and a number- 
input control 945 in a single row. The fourth FlowFrame 91 3 includes a "Play" 
button 950, and a "Slide Show" button 955 in a single row. Note that in the first 
and second rows, 91 0 and 91 1 , i.e., the "Speed" and "Sound" rows, the dropdown 
controls 920 and 930, respectively, expand to fill available width, so that the "Loop 
until next sound" checkbox 935 always reaches the right side of the task pane 900. 

[01 1 0] Next, as illustrated by FIG. 1 0, the dropdown controls 920 and 930 are the first 
things to shrink as the task pane 900 is made narrower. These dropdown controls 
920 and 930 will continue to shrink as the task pane is narrowed until they reach 
their minimum specified sizes. 

[01 1 1] Next, as illustrated by FIG. 1 1 , as the task pane is made narrower still, the 

"Loop until next sound" checkbox 935 can no longer fit in the same row, since the 
"Sound" dropdown 930 to its left must maintain its minimum width. Consequently, 
the "Loop until next sound" checkbox 935 drops to form a second row within the 
second FlowFrame 91 1 . The "Loop until next sound" checkbox 935 is indented to 
be aligned with the dropdown 930 above it, emphasizing that the checkbox and 
the dropdown above it are both members of the "Sound" group. Note that as 
illustrated by FIG. 1 1 , the "Automatically after" checkbox 940 and number-input 
945 don't have too much horizontal room to spare. 

[01 1 2] Next, as illustrated by FIG. 1 2, as the task pane 900 is narrowed still further, 
the "Automatically after" number-input 945 is the next control to be lowered into 
its own row by its FlowFrame 91 2. It is automatically indented by the "standard" 
indent width (the width of a square checkbox bitmap plus the gap between the 
checkbox bitmap and the associated text) to emphasize that it is logically 
associated with the checkbox above it. Further, it can be seen that the "Speed" and 
"Sound" dropdowns, 920 and 930, respectively, have been squeezed almost to 
their minimum width. If the task pane is made narrower they may not fit in the 
same row as their left-side text labels, 91 5 and 925, respectively. 



[0113] 



Next, as illustrated by FIG. 1 3, as the task pane 900 is narrowed again, it can 
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be seen that the "Speed" and "Sound" dropdowns, 920 and 930, respectively, drop 
to form their own rows within their respective FlowFrames, 91 0 and 91 1 . They 
remain indented by just the small, "standard" indent width, to emphasize their 
grouping within the "Speed" and "Sound" control groups, 91 5 and 925, 
respectively. The "Loop until next sound" checkbox 935 also shifts leftward, to 
retain its alignment with the dropdown 930 above it. 

[01 14] Finally, as illustrated by FIG. 14, as the task pane 900 is made even narrower, 
the "Play" and "Slide Show" buttons, 950 and 955, respectively, no longer fit in the 
same row, so their FlowFrame 91 3 splits them into two rows. This time the control 
on the second row (the "Slide Show" button) does not get indented, because the 
designer of this task pane has determined that there is no logical need for it to be. 
Also note that various text strings throughout the task pane no longer fit in a 
single line, so they wrap to multiple lines. Also, as discussed above, it should be 
noted that such wrapping does not occur in a new FlowFrame row, but rather, 
within the same FlowFrame row. In particular, a text control is made to wrap simply 
by reshaping it to be narrower and taller such that more than one row of text, as 
needed, will fit within the text control, which is itself contained within a single 
FlowFrame row. The vertical size of a FlowFrame row containing such a text control 
is automatically increased to accommodate the increased height of the text control. 
Furthermore, as the narrowing of the task pane causes the controls to occupy more 
and more rows, and the text to occupy more and more lines, the depletion of 
vertical space causes the list control near the top to get shorter and shorter (but 
still taller than its minimum required height, which is two list items tall). 

[0115] 5.0 Additional Embodiments: 

[0116] 

Because windows may be resizable, as discussed above, such resizable 
windows can be resized below a minimum width for fully displaying one or more of 
the controls within one or more of the rows of one or more FlowFrames. 
Consequently, where a window is resized in such a manner, in one embodiment, a 
scroll bar or the like is automatically instantiated within the window to allow a user 
to scroll the window for viewing obscured or clipped portions of the window. 
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However, in a related embodiment, the user is prevented from reducing the size of 
the window below a minimum threshold size in order to prevent the clipping of 
controls or children within any of the FlowFrames in that window. One method for 
determining this threshold size is to simply set the minimum width of a window to 
the largest minimum size of any children within the window. 

1 7] The foregoing description of the invention has been presented for the 

purposes of illustration and description. It is not intended to be exhaustive or to 
limit the invention to the precise form disclosed. Many modifications and variations 
are possible in light of the above teaching. It is intended that the scope of the 
invention be limited not by this detailed description, but rather by the claims 
appended hereto. 
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